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IMAGE PROCESSING APPARATUS AND METHOD 

This application is a continuation of 
International Application No. PCT/ JP02/13380, filed 
5 December 20, 2002, which claims the benefit of 

Japanese Patent Application No. 2001-398875, filed 
December 28, 2001. 

BACKGROUND OF THE INVENTION 

10 Field of the Invention 

The present invention relates to an image 
processing apparatus and an image processing method 
for compositing to display a plurality of images. 
Description of Related Art 

15 In general, in a self-luminescent type image 

display apparatus such as a CRT or a PDP, 
"persistence" tends to occur. "Persistence" is a 
phenomenon that causes reduction of an amount of 
emitted light only in a part of a screen where an 

20 identical image continues to be displayed. In a 

monitor of a computer that continues to display an 
identical image, if no instruction for operation is 
given to the computer for a predetermined time, a 
"persistence" prevention program called a screen 

25 saver starts up and displays an image that changes as 
time elapses on the screen. 

As an example of the screen saver, Japanese 
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Patent Application Laid-open No. 7-199889 discloses a 
system for displaying an image in a reduced size on a 
window smaller than an area where an image display 
apparatus can be displayed and, at the same time, 
5 moving this window as time elapses, thereby 

preventing a specific image from continuing to be 
displayed in a specific position of the image display 
apparatus . 

Japanese Patent Application Laid-open No. 2000- 

10 227775 discloses a system for moving an entire 

displayed image continually by a degree of several 
pixels that is not offending visually, thereby 
preventing a specific image from continuing to be 
displayed in a specific position of an image display 

15 apparatus. 

In addition, a screen saver function as 
disclosed in Japanese Patent Application Laid-open No. 
7-199889 is devised on the premise that it is used 
with a computer. It functions when an operator is 

20 not operating the computer, in general, when the 

operator is not watching a screen of the computer. 

In recent years, digitalization of televisions 
such as BS digital broadcasting and terrestrial 
digital broadcasting has advanced. A television 

25 receiver (system) corresponding to the digitization 
displays a plurality of images simultaneously or 
displays a symbol image including various kinds of 
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icons according to an OSD system as indications for 
various operations. A boundary part of windows in 
the case of multi-window display for displaying a 
plurality of images simultaneously and a symbol image 
5 including icons always displayed in an identical part 
can be causes of persistence. 

In the case of a television, it is necessary to 
continue to display images whether or not the 
television receives an operational instruction. Thus, 

10 it is impossible to cause the screen saver function 

as disclosed in Japanese Patent Application Laid-open 
No. 7-199889 to work. 

The system disclosed in Japanese Patent 
Application Laid-open No. 2000-227775 is also 

15 effective in the case in which a fixed image is 

continuously displayed. However, a drawing area that 
is larger than an area of all pixels of a displayed 
image and an area for displaying no image around the 
drawing area have to be prepared, or an area around a 

20 displayed image has to be trimmed and displayed. 

Moreover, an entire screen always moves. Thus, there 
is an inconvenience in that the system gives a sense 
of discomfort to viewers. 
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SUMMARY OF THE INVENTION 

Under such a background, the present invention 
has been devised in order to solve problems such as 
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those described above. It is an object of. the 
present invention to appropriately shift a display 
position of a symbol image or a multi-window by 
several pixels and cause it to change, and prevent 
5 the symbol image or the multi-window from being 

always displayed in an identical position, thereby 
preventing or reducing persistence of a fixed pattern. 

In addition, it is another object of the 
present invention to blur a display boundary part of 

10 a symbol image or a multi-window or cause the display 
boundary part to change in position subtly every time 
the symbol image or multi-window is displayed, 
thereby preventing persistence of a fixed pattern and 
making it less conspicuous. 

15 Under such objects, according to the present 

invention, as an embodiment mode thereof, there is 
provided an image processing apparatus, including: 

input means for inputting first image data and 
second image data; 

20 determining means for determining a display 

position of the second image; and 

display control means for superimposing one of 
the first image and the second image on the other and 
displaying the first and second images on a monitor 

25 such that the second image is positioned in the 

display position determined by the determining means; 
in which the determining means determines a 
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display position' of the second image such that the 
display position is changed within a range that is 
apart from the display position determined last time 
by a predetermined number of pixels. 
5 Objects of the present invention other than the 

above and characteristics of the objects will be 
apparent from the following detailed description of 
an embodiment mode of the present invention with 
reference to drawings, 

10 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a structure 
of a multi-window composition unit in first and third 
embodiments; 

15 Figs. 2A, 2B, 2C, 2D and 2E are diagrams 

showing an example of a displayed image and timing 
for switching image data; 

Fig. 3 shows an example of a circuit of 
synchronizing signal converters 20, 22 and 24; 
20 Figs. 4A, 4B, 4C, 4D, 4E, 4F, 4G, 4H and 41 

show examples of a wave form of each part of the 
circuit shown in Fig. 3; 

Fig. 5 is a flow chart for determination of a 
display position; 
25 Figs. 6A, 6B and 6C show first to third 

examples of display position history data; 

Fig. 7 is a block diagram showing a structure 
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of a multi-window composition unit in a second 
embodiment; 

Figs. 8A, 8B and 8C are examples of display of 
a composited image; 
5 Fig. 9 shows an example of image display in the 

third embodiment; 

Fig. 10 is a block diagram showing a structure 
of a multi-window composition unit in a fourth 
embodiment; 

10 Fig. 11 shows an example of a screen structure 

in the fourth embodiment; 

Figs. 12A, 12B and 12C show examples of a 
waveform of image data in the fourth embodiment; 
Fig. 13 is a block diagram of a schematic 
15 structure of a multi-window composition unit in a 
fifth embodiment; 

Fig. 14 shows an example of a screen structure 
in the fifth embodiment; 

Figs. ISA, 15B and 15C are examples of a 
20 waveform of image data in the fifth embodiment; 

Fig. 16 is a block diagram showing a structure 
of a multi-window composition unit in a sixth 
embodiment; 

Fig. 17 shows an example of a screen structure 
25 in the sixth embodiment; 

Figs. 18A, 18B and 18C show examples of a 
waveform in the sixth embodiment; 
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Fig. 19 is a block diagram showing a structure 
of a multi-window composition unit in a seventh 
embodiment; 

Fig. 20 shows an example of a screen structure 
5 in the seventh embodiment; 

Fig* 21 shows an example of a screen structure 
in an eighth embodiment; 

Figs. 22A, 22B and 22C show examples of a 
waveform in the eighth embodiment; and 
10 Fig. 23 shows an example of display for 

expanding and reducing an image size. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 

An embodiment mode of the present invention 
15 will be hereinafter described in detail based on the 

accompanying drawings. 

Embodiments of the present invention will be 

hereinafter described in detail with reference to the 

accompanying drawings. 
20 First embodiment 

Fig. 1 shows a block diagram of a schematic 

structure of a multi-window composition unit for a 

television receiver that is a first embodiment of the 

present invention . 
25 In the figure, reference numeral 10 denotes a 

first digital image signal input terminal and 12 

denotes a second digital image signal input terminal. 



Reference numerals 14 and 16 denote first and second 
image memories for storing image data for one frame 
inputted from the first and second digital image 
signal input terminals 10 and 12. Reference numeral 
5 18 denotes an icon image data generator for 
generating image data of an icon image to be 
displayed as a symbol. 

Reference numerals 20, 22 and 24 denote first, 
second and third synchronizing signal converters for 

10 staggering timing of an inputted synchronizing signal 
to output the synchronizing signal; 26, a CPU for 
controlling the multi-window composition unit; 28, a 
nonvolatile memory such as an EE PROM for storing a 
history of each image display position and a program 

15 to be executed in the CPU 26; and 30, a synchronizing 
signal generator. 

Reference numeral 32 denotes an image data 
selector for switching image data from the first and 
second image memories 14 and 16 and the icon image 

20 data generator 18 one by one; 34, an image data 

output buffer; and 36, an image data output terminal. 

A not-shown image source, for example, a 
digital broadcast receiving tuner, an image data 
recording medium such as an HDD, an A/D converter for 

25 quantizing an analog image signal, or the like are 

connected to the first and second image signal input 
terminals 10 and 12. Image data inputted from the 
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image source is written in the first and second image 
memories 14 and 16 once. Then, the image data is 
expanded or reduced to an image size corresponding to 
an instruction from the CPU 26, and priority 
5 information of each image is added to the image data. 
The image data is read out to the image data selector 
32 in synchronism with a synchronizing signal from 
the first and second synchronizing signal converters 
20 and 22. The priority information added to the 

10 image data is data of 2 bits added to each pixel. 

The data consists of "00" in an invalid image period 
and consists of "01" or "10" in a valid image period. 
The priority information is set by the CPU 26. 

The icon image data generator 18 generates 

15 image data for icons in accordance with an 

instruction from the CPU 2 6 and outputs the image 
data together with its priority information to the 
image data selector 32 in synchronism with a 
synchronizing signal from the third synchronizing 

20 signal converter 24. The priority information of the 
image data for icons is "11" for a pixel in which an 
icon exists and "00" for a pixel in which no icon 
exists . 

The image data selector 32 selects each image 
25 data from the first and second image memories 14 and 
16 and the icon image data generator 18 one by one 
and outputs the image data in synchronism with a 
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synchronizing signal. The image data selector 32 
selects each image data based on the priority 
information added to each image data. That is, the 
image data selector 32 selects, for each pixel, image 
5 data having priority information with a largest value. 
If the priority data of any image data is "00", the 
image data selector 32 selects no image data and 
replaces all bits with "0". In this way, the image 
data selector 32 composites each image data. An 

10 image composited in this way is outputted from the 
image data output terminal 36 via the image data 
output buffer 34. A not-shown image display device 
displays image data outputted from the image data 
output terminal 36 as an. image. 

15 Figs. 2A to 2E show an example of an image 

composited by the multi-window composition unit and 
timing for switching image data. Figs. 2A to 2E are 
explanatory views of a screen drawn on the image 
display device. Fig. 2A shows an example of a 

20 displayed image. Figs. 2B to 2E show timing on one 
line corresponding to a part indicated by a broken 
line in Fig. 2A. 

In Fig. 2A, reference numeral 40 denotes a 
background where no image is drawn. Here, it is 

25 assumed that the background 40 is colored only in 
black. Reference numeral 42 denotes an image 
consisting of a pattern of the Shinkannsen of image 
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data to be inputted in the image signal input 
terminal 10. Reference numeral 44 denotes an image 
consisting of a pattern of the map of Japan of image 
data to be inputted in the image signal input 
5 terminal 12. Reference numeral 46 denotes an icon 
image from the icon image data generator 18. 

Figs. 2B, 2C, 2D and 2E show priority 
information of image data from the image signal input 
terminal 10, priority information of image data from 

10 the image signal input terminal 12, priority 

information of icon image data from the icon image 
data generator 23, and a result of selection by the 
image data selector 32, respectively. 

In the figures, tO indicates drawing start 

15 timing of one line, and t6 indicates drawing finish 
timing of one line. Each image is switched at each 
timing of tl, t2, t3, t4 and t5. In the periods of 
tO to tl and t5 to t6, since priority information of 
all sources is "00", the selector 32 does not select 

20 any image data. In the period of t4 to t5, since 

priority information "01" of the image data (pattern 
of the Shinkansen) from the image signal input 
terminal 10 is a maximum value, the selector 32 
selects image data from the first image memory 14. 

25 In the periods of tl to t2 and t3 to t4, since 

priority information "10" of the image data (pattern 
of the map of Japan) from the image signal input 
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terminal 12 is a maximum value, the selector 32 
selects image data from the second image memory 16. 
In the period of t3 to t4, since priority information 
"11" of the icon data from the icon image data 
5 generator 18 is a maximum value, the selector 32 
selects icon image data from the icon image data 
generator 18. 

In this way, when selection by the image data 
selector 32 is switched for each pixel according to 
10 priority information, an image is composited as shown 
in Fig. 2A. 

A function characteristic of this embodiment 
resides in the synchronizing signal converters 20, 22 
and 24. Fig. 3 shows an example of a detailed 

15 circuit structure of the synchronizing signal 
converters 20, 22 and 24. Figs. 4A to 41 show 
waveforms (timing) of each part of the synchronizing 
signal converters shown in Fig. 3. 

Reference numeral 50 denotes an input terminal 

20 of a pixel clock CLK; 52, an input terminal of a 

horizontal synchronizing signal Hsync; 54, an input 
terminal of a vertical synchronizing signal Vsync; 56, 
an input terminal of a horizontal timing control 
signal Hcont; and 58, an input terminal of a vertical 

25 timing control signal Vcont . 

Reference numerals 60, 62, 64 and 66 denote D 
flip flops serially connected to each other, and 68 
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denotes a multiplexer for selecting an input signal 
of the input terminal 52 and outputs of the D flip 
flops 60, 62, 64 and 66 in accordance with the 
horizontal timing control signal Hcont from the input 
5 terminal 56 . 

Reference numerals 70, 72, 74 and 76 denote D 
flip flops serially connected to each other, and 78 
denotes a multiplexer for selecting an input signal 
of the input terminal 54 and outputs of the D flip 

10 flops 70, 72, 74 and 76 in accordance with the 

vertical timing control signal Vcont from the input 
terminal 58. 

Reference numeral 80 denotes a D flip flop for 
latching an output of the multiplexer 68 in 

15 accordance with a clock from the input terminal 50/ 
82, a D flip flop for latching an output of the 
multiplexer 78 in accordance with a clock from the 
input terminal 50; 84, an output terminal for 
outputting a horizontal synchronizing signal from the 

20 D flip flop 80; and 86, an output terminal for 

outputting a vertical synchronizing signal from the D 
flip flop 82 

Fig. 4A shows a pixel clock CLK inputted in the 
input terminal 50. Fig. 4B shows a horizontal 
25 synchronizing signal Hsync inputted in the input 

terminal 52. Figs. 4C to 4F show outputs of the D 
flip flops 60, 62, 64 and 66, respectively. Fig. 4G 



14 



shows a horizontal synchronizing signal Hsync 
outputted from the output terminal 84. Fig. 4H shows 
a vertical synchronizing signal inputted in the input 
terminal 54. Fig. 41 shows a signal waveform of a 
5 vertical synchronizing signal Vsync outputted from 
the output terminal 84. 

As shown in Figs. 4C, 4D, 4E and 4F, the D flip 
flops 60, 62, 64 and 66 delay the horizontal 
synchronizing signal Hsync by one pixel for each 

10 stage. The multiplexer 68 selects any one of these 
horizontal synchronizing signals delayed by one to 
four pixels and the horizontal synchronizing signal 
Hsync that is not delayed. 

Similarly, as to vertical synchronizing signals, 

15 the multiplexer 78 selects any one of vertical 
synchronizing signals delayed by one to four 
horizontal scanning periods by the D flip flops 70, 
72, 74 and 76 and a vertical synchronizing signal 
that is not delayed. 

20 The horizontal synchronizing signal and the 

vertical synchronizing signal selected by the 
multiplexers 68 and 78 are timed by the D flip flops 
80 and 82 and outputted from the output terminals 84 
and 86, respectively. 

25 The selections by the multiplexers 68 and 78 

are controlled by the horizontal timing control 
signal' Hcont and the vertical timing control signal 
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Vcont from the CPU 26, respectively. A horizontal 
synchronizing signal output and a vertical 
synchronizing signal output that are staggered in 
timing in the range of one to five pixels both 
5 horizontally and vertically are obtained according to 
a combination of the horizontal timing control signal 
Hcont and the vertical timing control signal Vcont. 

For example, Figs. 4A to 41 show cases in which 
the multiplexer 68 selects an output of the D flip- 

10 flop 66 and the multiplexer 78 selects a vertical 
synchronizing signal input. In this case, as shown 
in Fig. 4F, a horizontal synchronizing signal delayed 
by four clocks with respect to an input and a 
vertical synchronizing signal without delay with 

15 respect to an input are inputted in the D flip flops 
80 and 82, respectively. The D flip flops 80 and 82 
time changing points of both the inputs, and as shown 
in Figs. 4G and 41, output the horizontal 
synchronizing signal Hsync and the vertical 

20 synchronizing signal Vsync that are delayed by five 
pixels in the horizontal direction and by zero pixel 
in the vertical direction with respect to the input. 

In this way, the horizontal synchronizing 
signal and the vertical synchronizing signal that are 

25 staggered in timing in the range of one to five 

pixels are used, respectively, and image data and 
priority information accompanying the image data are 
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read out from the first and second image memories 14 
and 16 and the icon image data generator 18, whereby 
the switching timing in the image data selector 32 is 
also staggered in the range of one to five pixels in 
5 the horizontal and vertical directions. 

A method with which the CPU 2 6 determines 
delayed time in the horizontal and vertical 
directions of the synchronizing signal converters 20, 
22 and 24 will be described. In this embodiment, a 

10 variable range of a display position is five pixels 
for both horizontally and vertically. Therefore, 
there are shift patterns of display position for five 
pixels horizontally and vertically, respectively, 
that is, there are shift patterns of display position 

15 of twenty-five types in total. Any one of these 

twenty-five shift patterns of display position will 
be selected. A shift pattern of display position 
with a shortest accumulated time among display 
accumulated times of the twenty-five shift patterns 

20 of display position is selected and set, whereby a 

display accumulated time in each display position can 
be unif ormalized as much as possible. 

Fig. 5 shows a flow chart of this set value 
determining operation. Figs. 6A to 6C show examples 

25 of display position history data in which a history 
of each image display position used for the 
determination is stored. There are different display 
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position history data for each window display pattern 
and for each type of an icon. These display position 
history data are stored in the nonvolatile memory 28. 
Thus, even if a power supply is turned off, a value 
5 of the display position history data before turning 
off the power supply is held. 

The flow chart shown in Fig. 5 starts when 
multi-window display or icon display is started by 
some operation of an operator. As an example, an 
10 operation in starting the icon display will be 
described. 

First, the CPU 26 reads out display position 
history data of the pertinent icon display (SI) . An 
example of display position history data is shown in 

15 Figs. 6A to 6C. This display position history data 
stores data on how many seconds shift patterns are 
used, respectively, for each display position shift 
pattern in five directions each horizontally and 
vertically, that is, twenty-five directions in total. 

20 The CPU 26 searches a shift pattern with a value "0" 
among the shift patterns. In the case of Fig. 6A, a 
cell (4,4) corresponds to the shift pattern. Here, 
if there are a plurality of shift patterns with a 
value "0" (e.g., in the case of an initial state), an 

25 arbitrary shift pattern may be selected. 

Next, in order to display an image with this 
shift pattern, the CPU 26 designates the display 
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position of (4,4) and causes the synchronizing signal 
converter 24 to output a horizontal synchronizing 
signal and a vertical synchronizing signal that are 
shifted by four pixels both horizontally and 
5 vertically (S2) . More specifically, the CPU 26 

causes the multiplexers 68 and 78 to select outputs 
of the D flip-flops 64 and 74. Then, the CPU 26 
starts display (S3) and starts a timer for measuring 
elapsed time (S4) . The CPU 26 loops steps S5 and S6 

10 until the icon display is finished (SI), and 

increments display position history data of the cell 
(4,4) at every second during that period. 

When the icon display is finished (S7), the CPU 
26 stops the timer for measuring elapsed time and 

15 reads out the display position history data again 
(S8) . An example of the read out display position 
history data is shown in Fig. 6B. In an example 
shown in Fig. 6B, data of the cell (4,4) shows that 
an icon has been displayed for 420 seconds. 

20 The CPU 26 searches a lowest value from each 

cell shown in Fig. 6B (S9) . In Fig. 6B, "5" of the 
cell (3,1) corresponds to the lowest value. The CPU 
26 updates values in all the display position history 
data to values found by subtracting "5 seconds", 

25 which is the lowest value, from the values (S10) . An 
example of display position history data after update 
is shown in Fig. 6C. Thereafter, the CPU 26 prepares 
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for the next icon display. As shown in Fig. 6C, a 
value of the cell (3,1) changes to "0", and an icon 
is displayed with a shift pattern of the cell (3,1) 
in the next icon display. 
5 Second embodiment 

Fig. 7 shows a block diagram of a schematic 
structure of a second embodiment of the present 
invention. The same components as those in the 
embodiment shown in Fig. 1 are denoted by the same 

10 reference numerals. 

Reference numeral 90 denotes an image memory 
for storing output image data; 92 and 94, first and 
second resolution converters for expanding and 
reducing image data to be inputted from the first and 

15 second digital image signal input terminals 10 and 12, 
respectively; 96 and 98, first and second address 
converters for converting address data included in 
image data from the first and second resolution 
converters 92 and 94; and 100, a third address 

20 converter for converting address data included in 
image data from the icon image data generator 18. 

The first and second resolution converters 92 
and 94 convert a resolution of image data inputted 
from the image signal input terminals 10 and 12 in 

25 accordance with an instruction from the CPU 26, 

respectively, thereby converting an image size. The 
image data with a resolution converted by the 
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resolution converters 92 and 94 and the image data 
from the icon image data generator 18 are outputted 
together with coordinate data indicating a position 
on a screen. When the image data are outputted, 
5 priority information corresponding to the instruction 
from the CPU 2 6 is added to the image data for each 
pixel as in the case of the first embodiment. 

The priority information is written in a 
coordinate position of the memory 90 indicated by the 

10 coordinate data together with the image data. When 
the image data is written in the memory 90, priority 
information of the image data to be written and 
priority information already written are compared for 
each pixel. Only when the priority information of 

15 the image data to be written has a larger value, the 
image data is actually written in the memory 90. 
That is, image data with larger priority information 
is overwritten in the memory 90 prior to existing 
image data. 

20 Fixed values designated by the CPU 26 are added 

to each coordinate data, which is outputted from the 
resolution converters 92 and 94 and the icon image 
data generator 18, in the address converters 96, 98 
and 100. Then, each coordinate data is applied to 

25 the memory 90. When the address converters 96, 98 
and 100 adds n to coordinate data in the horizontal 
direction, the image data is written in a position 



21 



shifted to the right by n pixels on the memory 90. 
When m is added to coordinate data in the vertical 
direction, the image data is written in a position 
shifted downward by m pixels. The CPU 26 manages the 
5 added values n and m based on the display position 
history data as in the first embodiment. 

The image data with a resolution converted by 
the resolution converters 92 and 94 and the image 
data from the icon image data generator 18 are 

10 written in a storage position corresponding to a 
display position on the memory 90 according to an 
instruction from the CPU 26. Image data established 
on the memory 90 is read out in order in accordance 
with a synchronizing signal from the synchronizing 

15 signal generator 30 and, at the same time, priority 
information of each pixel is returned to "00" and is 
prepared for writing in a new frame. 

The image data read out from the memory 90 is 
outputted from the image data output terminal 36 via 

20 the image data output buffer 34 as in the first 
embodiment . 

Note that, although a multi-window display 
position and an icon display position are managed 
based on display position history data when the 

25 positions are determined in the first and second 
embodiments, a value generated at random within a 
predetermined range may be used to determine the 
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positions every time multi-window display or icon 
display is started. 

Moreover, a variable range of a display 
position is not limited only to five pixels both 
5 horizontally and vertically but may be values such as 
two pixels, three pixels or seven pixels, or may be 
different values horizontally and vertically, 
respectively. 

Although, in display position history data, 
10 display time is measured by the unit of one second 
for each display position, any unit may be adopted 
such as the unit of ten seconds, thirty seconds or 
one minute. In symbol display such as an icon, it is 
considerable that the display automatically ends in a 
15 predetermined time from the start of display. A 
method of changing a display position in order is 
also possible. 

A screen drawn on an image display device using 
a multi-window composition unit is effective not only 
20 for two screens of a reduced size as illustrated in 
Fig. 2A but also for any combination such as a case 
in which OSD display is performed on one full screen 
as shown in Fig. 8A, a case in which a sub-screen is 
superimposed on one full screen as shown in Fig. 8B, 
25 and a case in which two trimmed images are placed 
side by side as shown in Fig. 8C. 

For example, as shown in Figs. 8A and 8B, if 
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another image is arranged on one full screen, a 
display position of the image arranged on the one 
full screen is changed while fixing a display 
position of the one full screen. 
5 As shown in Fig* 8C, when the two trimmed 

images are placed side by side, the number of pixels 
in the lateral direction of both the images is 
increased so as to be more than the number of pixels 
in the lateral direction of the display device by 

10 several pixels and, then, an image display position 
having higher priority (to be arranged in the upper 
side) is changed to the left and the right, whereby a 
boundary position (trimming portion) of both the 
images is changed to the left and the right. In the 

15 vertical direction, the display positions of both the 
images are aligned and changed together. 

In this way, the present invention is 
applicable to any combination of images. The number 
of input sources is not limited to two, and it is 

20 possible to implement the present invention with 
three screens, or four or more screens. 

Although each embodiment uses digital image 
data, it is needless to mention that, if resolution 
conversion such as expansion or reduction is not 

25 required, the same effect can be expected by changing 
a relative position of a synchronizing signal and an 
image signal with respect to an analog signal. 
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Third embodiment 

A block diagram showing a schematic structure 
of a multi-window composition unit for a television 
receiver that is a third embodiment of the present 
5 invention is the same as Fig. 1. Thus, its 

description will be omitted. However, whereas the 
image data selector 32 is drawn as a switch for one 
circuit in Fig. 1, the image data selector 32 in this 
embodiment consists of switches for three channels of 

10 R, G and B, or Y, U and V. Each switch changes over 
referring to priority information added to 
corresponding component data. 

In giving priority information to each image 
data, the CPU 2 6 changes a boundary of the image data 

15 at random in a range in the order of several pixels 
such that the boundary does not form a straight line. 
Consequently, the boundary is drawn as a zigzag line 
on a composited image. Fig. 9 shows an example of 
display in which an image of a mountain hut is 

20 reduced and displayed over an image of a mountain 

scenery simultaneously with displaying the image of a 
mountain scenery. 

The priority information to be changed at 
random in the range in the order of several pixels 

25 may be updated for each frame and changed at a speed 
that does not allow visual distinction, or may be 
changed every time display is started without being 
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changed during a period from display start to display 
end. 

Fourth embodiment 

Fig. 10 is a block diagram of a schematic 
5 structure of a fourth embodiment that is incorporated 
in a television receiver. Components performing the 
same actions as those shown in Fig. 1 are denoted by 
the same reference numerals. Reference numerals 138 
and 140 denote attenuators for reducing amplitude of 

10 image data from the first and second image memories 
14 and 16 by a factor of 1/2 or zero, respectively. 
Reference numeral 142 denotes an attenuator for 
reducing amplitude of image data from the icon image 
data generator 18 by a factor of 1/2 or zero. 

15 Reference numeral 144 denotes an adder for adding 
outputs of the attenuators 138, 140 and 142. 

In the case of this embodiment, each input 
image source may be a YUV signal or an RGB signal. 
Here, it is assumed to be the RGB signal. 

20 Image data stored in the first and second image 

memories 14 and 16 are expanded or reduced to an 
image size corresponding to an instruction from the 
CPU 26, respectively, and at the same time, priority 
information of each image and boundary information 

25 discussed later are added to the image data. The 

image data is applied to the attenuators 138 and 140 
in accordance with synchronizing signals from the 
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synchronizing signal converters 20 and 22. The icon 
image data generator 18 outputs an icon image, to 
which the priority information and the boundary 
information are added, in accordance with a 
5 synchronizing signal from the synchronizing signal 
converter 124. 

The priority information in this case consists 
of data of two bits added for each pixel as in the 
case of the third embodiment. As the data, "00" is 

10 set in an invalid image period and "01" or "10" is 
set in a valid image period by the CPU 126. The 
boundary information consists of data of one bit 
added for each pixel. As the data, "1" is set to a 
pixel corresponding to a boundary part of a screen by 

15 the CPU 126. 

The attenuators 138, 140 and 142 are provided 
with attenuating means for three channels of R, G and 
B, respectively. An attenuation ratio is switched 
with reference to the priority information and the 

20 boundary information added to each image data. In 
the case in which the boundary information is "1", 
the attenuation ratio is reduced to half. In the 
case in which the boundary information is "0", an 
attenuation ratio of one is set to image data with 

25 highest priority information, and an attenuation 

ratio of zero (mute) is set to the other image data. 
Fig. 11 shows a schematic view of a screen 
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structure for an image generated by the multi-window 
composition unit shown in Fig, 1. Fig. 12A shows a 
waveform chart corresponding to Fig, 11. Control of 
attenuation amounts of the attenuators 138, 140 and 
5 142 based on priority information and boundary 

information will be described with reference to Fig. 
12A. Reference numeral 150 denotes a background 
image area; 152, a boundary part image area; and 154, 
an icon image area. In the background image area 150, 

10 boundary information of an icon is "0" and priority 
information of the icon is "00". In the boundary 
part image area 152, boundary information of an icon 
is "1" and priority information of the icon is "11". 
In the icon image area 154, boundary information of 

15 an icon is "0" and priority information of the icon 
is "11". Note that, although image data to be 
processed is digital data, the image data is 
illustrated with an analog waveform in Fig. 12A for 
ease of visual recognition. Fig. 12A shows a signal 

20 waveform in a part corresponding to a broken line 156 
of Fig. 11. In the example shown in Fig. 12A, an 
icon of a single color green is superimposed on a 
bluish background image and displayed. 

In the background image area 150, an 

25 attenuation ratio of the background image is one and 
an attenuation ratio of the icon image is zero. In 
the icon image area 154, conversely, an attenuation 
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ratio of the background image is zero and an 
attenuation ratio of the icon image is one. In the 
boundary part image area 152, an attenuation ratio of 
both the background image and the icon image is half. 
5 Each image data is multiplied by weights of these 

attenuation amounts and, then, composited (added) by 
the adder 14 4. 

As a result, in the boundary part image area 
152, an image (transparent image) in which the 

10 background image and the icon image are mixed is 

formed, which relaxes a sharp change in an RGB signal 
when the image is displayed. 

For reference, a change in an RGB signal in the 
case in which an icon of a single color green is 

15 superimposed on a background image of a single color 
black is shown in Fig. 12B, and a change in an RGB 
signal in the case in which an icon of a single color 
green is superimposed on a background image of a 
single color white is shown in Fig. 12C. 

20 Fifth embodiment 

Fig. 13 shows a block diagram of a schematic 
structure of a fifth embodiment of the present 
invention. Components performing the same actions as 
those shown in Fig. 10 are denoted by the same 

25 reference numerals. Multipliers 160, 162 and 164 are 
arranged instead of the attenuators 138, 140 and 142 
of the embodiment shown in Fig. 10. Actions of the 
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other components are basically the same as those in 
the embodiment shown in Fig. 10 except that an 
attenuation ratio and a multiplier are different. 
The multipliers 160, 162 and 164 multiply image data 
5 from the first and second image memories 14 and 16 

and the icon image data generator 18 by a coefficient 
based on priority information and multiplication 
information . 

An input image source may be a YUV signal or an 

10 RGB signal. Here, the case in which the input image 
source is the RGB signal will be described. 

Image data stored in the first and second image 
memories 14 and 16 are expanded or reduced to an 
image size corresponding to an instruction from the 

15 CPU 26, respectively, and at the same time, priority 
information and multiplication information of each 
image are added to the image data . The image data 
are applied to the multipliers 160 and 162 in 
accordance with synchronizing signals from the 

20 synchronizing signal converters 20 and 22. The icon 
image data generator 18 outputs an icon image, to 
which the priority information and the multiplication 
information are added, in accordance with a 
synchronizing signal from the synchronizing signal 

25 converter 24. Multiplication information is a value 
set for each pixel in an image boundary part and 
takes a value from 0 to 100%. 



30 



The multipliers 160, 162 and 164 are provided 
with multiplication means for three channels of R, G 
and B, respectively. The multipliers 160, 162 and 
164 multiply image data with highest priority by 
5 multiplication information a(%) that is added to the 
image data. The multipliers 160, 162 and 164 
multiply image data with second highest priority by a 
coefficient (100-a) (%) that is obtained from the 
multiplication information a (%) added to the image 

10 data with highest priority. The multipliers 160, 162 
and 164 multiply image data with third highest or 
lower priority by 0 (%) . The adder 144 adds up each 
image data subjected to the multiplication processing. 
Fig. 14 shows a schematic view of a screen 

15 structure for an image generated by the multi-window 
composition unit shown in Fig. 13. Figs. 15A, 15B 
and 15C show waveform charts corresponding to Fig. 14. 
Actions of the multipliers 160, 162 and 164 based on 
priority information and multiplication information 

20 will be described with reference to Fig. 15A. 

Reference numeral 170 denotes a background image 
area; 172, a boundary part gradation image area; and 
17 4, an icon image area. In the background image 
area 170, priority information of an icon is "00". 

25 In the boundary part gradation image area 172, 
priority information of an icon is "11" and 
multiplication information of the icon is less than 
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100 (%) . In the icon image area 174, priority 
information of an icon is "11" and multiplication 
information of the icon is 100 (%) . Note that, 
although image data to be processed is digital data, 
5 the image data is illustrated with an analog waveform 
in Fig. 15A. Fig. 15A shows a signal waveform in a 
part corresponding to a broken line 176 of Fig. 14. 
In the example shown in Fig. 15A, an icon of a single 
color green is superimposed on a bluish background 

10 image and displayed. 

In the background image area 170, priority of a 
background image is highest, and background image 
data is multiplied by multiplication information (a = 
100(%)) added to the background image data and the 

15 other image data is multiplied by 0 (= 100-a) (%) . 

In addition, in the icon image area 174, conversely, 
priority of icon image data is high, background image 
data is multiplied by 0 (%), and icon image data is 
multiplied by 100 (%) . 

20 In the boundary part gradation image area 172, 

multiplication information "a" that gradually changes 
is added. More specifically, "a" equals to 0 (%) in 
its outermost peripheral part, gradually increases 
toward its inner periphery, and reaches 100 (%) in 

25 its innermost peripheral part. The adder 144 mixes 
an icon image and a background image based on this 
multiplication information at a ratio of a (%) to 
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(100-a) (%). 

As a result, in the boundary part gradation 
image area 172, an image (transparent image) is 
obtained in which the background image is mixed with 
5 the icon image and the mixed image gradually switched 
to the icon image from the outer periphery toward the 
inner periphery. In this way, when the mixed image 
is displayed by a not-shown image display device, a 
sharp change in an RGB signal is relaxed. 

10 For reference, a change in an RGB signal in the 

case in which an icon of a single color green is 
superimposed on a background image of a single color 
black is shown in Fig. 15B, and a change in an RGB 
signal in the case in which an icon of a single color 

15 green is superimposed on a background image of a 
single color white is shown in Fig. 15C. 
Sixth embodiment 

Fig. 16 shows a block diagram of a schematic 
structure of a sixth embodiment of the present 

20 invention. Components performing the same actions as 
those shown in Figs. 1, 10 and 13 are denoted by the 
same reference numerals. 

Image data stored in the first and second image 
memories 14 and 16 are expanded or reduced to an 

25 image size corresponding to an instruction from the 
CPU 26, respectively, and at the same time, priority 
information and multiplication information of each 
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image are added to the image data. The image data 
are applied to the multipliers 160 and 162 in 
accordance with synchronizing signals from the 
synchronizing signal converters 20 and 22. The icon 
5 image data generator 18 outputs an icon image, to 

which the priority information and the multiplication 
information are added, in accordance with a 
synchronizing signal from the synchronizing signal 
converter 24. The multiplication information is a 

10 value set for one pixel in an image boundary part and 
takes a value between 0 to 100%. 

An input image source may be a YUV signal or an 
RGB signal. However, the case in which the input 
image is the YUV signal will be described here. 

15 The multipliers 160, 162 and 164 are provided 

with multiplication means for three channels of R, G 
and B, respectively. The data selector 32 is also 
provided with switches for the three channels. The 
multipliers 160, 162 and 164 multiply each image data 

20 by multiplication information a (%) added to each 
image data. The multipliers 160, 162 and 164 add 
fixed data of 0.3 X (100-a) (%) to the Y signal and 
add fixed data of 0.5 X (100-a) (%) to the U and V 
signals. That is, as "a" decreases, the Y signal is 

25 brought close to a signal of 30IRE level, and the U 
and V signals of 8-bit gradation (256 gradation) are 
brought close to " 128h", that is, a center level that 
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is a value in the case of no color. 

Fig. 17 shows a schematic view of a screen 
structure for an image generated by a multi-window 
composition unit shown in Fig. 16. Figs. 18A to 18C 
5 show waveform charts corresponding to Fig. 17. 

Actions of the multipliers 160, 162 and 164 based on 
priority information and multiplication information 
will be described with reference to Fig. 18A. 
Reference numeral 180 denotes a background image 

10 area; 182, a background part gradation image area; 

184, an icon part gradation image area; 186, an icon 
image area; and 188, a boundary between the 
background part gradation image area 182 and the icon 
part gradation image area 184. 

15 Note that, although image data to be processed 

is digital data, the image data is illustrated with 
an analog waveform in Fig. 18A for ease of visual 
recognition. For ease of comparison with other 
embodiments, an RGB signal waveform is also 

20 illustrated. Fig. 18A shows a signal waveform in a 
part corresponding to a broken line 190 of Fig. 17. 
In the example shown in Fig. 18A, an icon of a single 
color green is superimposed on a bluish background 
image and displayed. 

25 Since priority information of an icon is "00" 

in the background image area 180 and the background 
part gradation image area 182, the image data 
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selector 132 selects background image data* Since 
priority information on an icon is "11" in the icon 
image area 18 6 and the icon part gradation image area 
184, the image data selector 132 selects icon image 
5 data. 

In the background part gradation image area 182 , 
background image multiplication information "a" 
equals to 100 (%) in its outermost peripheral part, 
gradually decreases toward its inner periphery, and 

10 reaches 0 (%) in the boundary 188. Similarly, in the 
icon part gradation image area 184, icon image 
multiplication information "a" equals to 0 (%) in its 
outermost peripheral part and gradually increases 
toward its inner periphery to reach 100 (%) * That is, 

15 contrast is gradually decreased toward the inner 

periphery in the background part gradation image area 
182 and toward the outer periphery in the icon part 
gradation image area 184, respectively, to reach gray 
of 30IRE in the boundary 188. 

20 In this way, the background image and the icon 

image are switched while gradually changing to gray 
of 30IRE in the background part gradation image area 
182 and the icon part gradation image area 184, which 
are boundary parts of both the images, whereby a 

25 sharp changes in RGB of a displayed image is relaxed. 

For reference, a change in an RGB signal in the 
case in which an icon of a single color green is 
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superimposed on a background image of a single color 
black is shown in Fig. 18B, and a change in an RGB 
signal in the case in which an icon of a single color 
green is superimposed on a background image of a 
5 single color white is shown in Fig. 18C. 
Seventh embodiment 

Fig. 19 shows a block diagram of a schematic 
structure of a seventh embodiment of the present 
invention. Components performing the same actions as 

10 those shown in Figs. 1, 10, 13 and 16 are denoted by 
the same reference numerals. Reference numeral 200 
denotes a filter for adding pixel data of pixels 
around the filter, and 200 denotes a line memory for 
two lines used in filtering processing. 

15 Image data stored in the first and second image 

memories 14 and 16 are expanded or reduced to an 
image size corresponding to an instruction from the 
CPU 26, respectively, and at the same time, priority 
information is added to the image data. The image 

20 data are read out in accordance with synchronizing 
signals from the synchronizing signal converters 20 
and 22. The icon image data generator 18 outputs an 
icon image, to which the priority information is 
added, in accordance with a synchronizing signal from 

25 the synchronizing signal converter 24. The image 

data selector 32 selects any one of image data from 
the first and second image memories 14 and 16 and the 
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icon image data from the icon image data generator 18 
by the unit of a pixel in accordance with an 
instruction from the CPU 26. 

In this embodiment, again, each input image may 
5 be a YUV signal or an RGB signal. 

The filter 200 applies filtering processing in 
accordance with an instruction from the CPU 2 6 to the 
image data selected by the image data selector 32. 
This filtering processing is roughly divided into 

10 three types. One of them is lateral filtering, which 
replaces image data of interest with a value found by 
adding pixel data of a pixel of interest by 50% and 
pixel data of two pixels adjacent to the pixel of 
interest on its left and right sides by 25%, 

15 respectively. Another one is longitudinal filtering, 
which replaces pixel data of interest with a value 
found by adding pixel data of a pixel of interest by 
50% and pixel data of two pixels adjacent to the 
pixel of interest above and below it by 25%, 

20 respectively. In this processing, image data for 
three lines are required vertically, and the line 
memory 202 for two lines is used. Third filtering 
processing is all direction filtering, which replaces 
pixel data of interest with a value found by adding 

25 pixel data of a pixel of interest by 25%, pixel data 
of four pixels adjacent to the pixel of interest 
above and below it, and on its left and right by 
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12.5%, and pixel data of four pixels adjacent to the 
pixel of interest in its oblique direction by 6.25%. 
The all direction filtering is equivalent to 
performing the processing of both the lateral 
5 filtering and the longitudinal filtering and can be 
realized without particularly preparing processing 
means for three types. 

Fig. 20 is a schematic view of a display screen 
structure of image data generated by a multi-window 

10 composition unit shown in Fig* 19 and shows the case 
in which an icon image is superimposed on a 
background image. 

When the icon image is superimposed on the 
background image, the CPU 26 instructs the filter 200 

15 to perform the filtering processing at timing close 

to a boundary position between the icon image and the 
background image. In the case of Fig. 20, an area 
226 subjected to hatching processing is an icon image. 
Reference numerals 210 and 212 denote lateral 

20 boundary areas; 214 and 216, longitudinal boundary 
areas; and 218, 220, 222 and 224, corner boundary 
areas. The CPU 26 instructs the filter 200 to apply 
the lateral filtering processing to the lateral 
boundary areas 210 and 212, the longitudinal 

25 filtering processing to the longitudinal boundary 
areas 214 and 216, and the all direction filtering 
processing to the corner boundary areas 218, 220, 222 



39 



and 224, and does not perform the filtering 
processing in the other areas. 

In this way, the filtering processing is 
applied to the area of several pixels in front, rear, 
5 left and right of the boundary between the icon image 
and the background image, whereby a sharp change in 
an RGB signal can be relaxed when it is displayed by 
a not-shown image display device. 
Eighth embodiment 

10 The multi-window composition unit of the 

structure shown in Fig. 1 is operated as follows. 
That is, Y, U and V image data stored in the first 
and second image memories 14 and 16 are expanded or 
reduced to an image size corresponding to an 

15 instruction from the CPU 28, respectively, and at the 
same time, priority information and boundary 
information of each image are added to the image data. 
The image data are supplied to the image data 
selector 32 in synchronism with a synchronizing 

20 signal from the synchronizing signal converters 20 
and 22. The priority information in this case 
consists of data of two bits added for each pixel. 
As the priority information, "00" is set for an 
invalid image period, "01" or "10" is set for a valid 

25 image period according to an instruction from the CPU 
26. In addition, the boundary information consists 
of data of one bit added for each pixel. As the 
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boundary information, "1" is set for a pixel in a 
boundary part and "0" is set for pixels in the other 
parts according to an instruction from the CPU 26. 

The icon image data generator 18 generates icon 
5 image data in accordance with an instruction from the 
CPU 26. The icon image data is supplied to the image 
data selector 32 together with the priority 
information and the boundary information in 
synchronism with a synchronizing signal from the 

10 synchronizing signal converter 24. Note that, as the 
priority information of the icon image data, "11" is 
given to a pixel in which an icon exists and "00" is 
given to a pixel in which no icon exists and, as the 
boundary information, "1" is set only in the boundary 

15 part according to an instruction from the CPU 26 as 
in the case of the image data. 

The image data selector 32 consists of switches 
for three channels of Y, U and V. Each switch 
changes over with reference to priority information 

20 and boundary information that are added to 
corresponding component data. 

In the case of the Y signal, the image data 
selector 32 operates based only on priority 
information. The image data selector 32 selects 

25 image data to which priority information with a 
largest value is given for each pixel. The image 
data selector 32 does not select any image data if 
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priority information is "00" for all the image data 
and replaces all bits of image data with "0". 

In the case of the U and V signals, the image 
data selector 32 uses both of priority information 
5 and boundary information. If the boundary 

information is "1", the image data selector 32 
replaces U and V signals of 8-bit gradation (256 
gradation) with "128h ll / that is, a center level that 
is a value in the case of no color. In the case in 

10 which the boundary information is "0", the image data 
selector 32 refers to the priority information and 
selects image data to which priority information with 
a largest value is given . The image data selector 32 
does not select any image data if priority 

15 information is "00" for all the image data and 
replaces the image data with "128h" . 

' In this way, the image data selector 32 
composites each image data. A result of the 
composition is outputted from the image data output 

20 terminal 36 via the image data output buffer 34. The 
image data outputted from this terminal is displayed 
by a not-shown image display device. 

Fig. 21 shows a screen structure in this 
operation. Fig. 22A shows an example of a signal 

25 waveform in a part corresponding to a broken line 238 
of Fig. 21. Although image data to be processed is 
digital data, the image data is illustrated with an 
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analog waveform in Fig. 22A for ease of visual 
recognition. In Fig. 22A, an output signal of the 
image data selector 32 is illustrated in both of the 
YUV system and the RGB system. Reference numeral 230 
5 denotes a background image area; 232, a boundary part 
background side image area; 234, a boundary part icon 
side image area; and 236, an icon image area. In the 
background image area 230, boundary information of an 
icon is "0" and priority information of the icon is 

10 also "00". In the boundary part background side 

image area 2 32, boundary information of an icon is 
"1" and priority information of the icon is "00". In 
the boundary part icon side image area 234, boundary 
information of an icon is "1" and priority 

15 information of the icon is "11". In the icon image 
area 236, boundary information is "0" and priority 
information is "11". 

Fig. 22A shows an example of a signal waveform 
of a part corresponding to the broken line 238 of Fig. 

20 21, which is a waveform at the time when an icon of a 
single color green is superimposed on a bluish 
background image and displayed. 

In the background image area 230, a background 
image is selected for both the Y signal and the U and 

25 V signals. In the icon image area 236, an icon image 
is selected for both the Y signal and the U and V 
signals. In the boundary part background side image 
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area 232 and the boundary part icon side image area 
234, the U and V signals are muted (replaced with 
ff 128h M ), and the background image and the icon image 
are selected, respectively, for the Y signal. As a 
5 result, a black and white image is displayed only on 
the boundary part background side image area 232 and 
the boundary part icon side image area 234, whereby a 
sharp change in an RGB signal at the time when an 
image is displayed is relaxed. 

10 For reference, a change in an RGB signal in the 

case in which an icon image of a single color green 
is superimposed on a background image of a single 
color black is shown in Fig. 22B. A change in an RGB 
signal in the case in which an icon image of a single 

15 color green is superimposed on a background image of 
a single color white is shown in Fig. 22C. 
Ninth embodiment 

The multi-window composition unit of the 
structure shown in Fig. 1 is operated as follows. 

20 That is, image data stored in the first and second 
image memories 14 and 16 are expanded or reduced to 
an image size corresponding to an instruction from 
the CPU 26, respectively. In this case, an expansion 
or reduction ratio of the image data is changed 

25 subtly every time the image data is expanded or 
reduced. For example, any one of five kinds of 
expansion or reduction ratios as indicated by 
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reference numerals 240 to 246 in Fig* 23 is 
appropriately selected to perform screen composition 
processing. Consequently, a boundary of icons or the 
like is prevented from being written repeatedly in a 
5 specific pixel position. 

An expansion or reduction ratio to be applied 
may be determined at random out of the five kinds of 
expansion or reduction ratios. Alternatively, it is 
also possible to store an accumulated display time of 

10 each expansion or reduction ratio in a nonvolatile 

memory such as an EEPROM and select each expansion or 
reduction ratio such that a frequency of use of each 
expansion or reduction ratio becomes equal. 

It is evident that the expansion or reduction 

15 ratio is not- limited to five kinds as in this example. 
Note that, although processing of a boundary 
part at the time of icon display is described as the 
third to ninth embodiments, it is needless to mention 
that the present invention is effective for any 

20 combination such as a case in which OSD display is 
performed on one full screen, a case in which sub- 
screens are superimposed on one full screen, and a 
case in which two trimmed images are placed side by 
side. In addition, the number of input sources is 

25 not limited to two screens, and the present invention 
can be implemented with three or more screens. 
Further, some of the embodiments may be 
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combined and used, for example, the third embodiment 
and the eighth embodiment are applied simultaneously 
to display only a "zigzag" boundary part, which 
changes every time an image is expanded or reduced, 
5 in black and white. 

Although the embodiments for using digital 
image data have been described, the same effects can 
be obtained with respect to an analog signal. 

As described above, according to the present 

10 invention, a display position of a symbol image or a 
multi-window display is appropriately changed by 
shifting several pixels to be changed to prevent the 
symbol image or the multi-window display from being 
always displayed in an identical position, whereby 

15 persistence of a fixed pattern can be prevented or 
reduced. 

In addition, a display boundary part of a 
symbol image or a multi-window display is blurred or 
the display boundary part is changed subtly every 
20 time the symbol image or multi-window display is 

displayed, whereby persistence of a fixed pattern can 
be prevented or made less conspicuous. 



